Journals
  Publication Years
  Keywords
Search within results Open Search
Please wait a minute...
For Selected: Toggle Thumbnails
Weakly perceived object detection method based on point cloud completion and multi-resolution Transformer
Jing ZHOU, Yiyu HU, Chengyu HU, Tianjiang WANG
Journal of Computer Applications    2023, 43 (7): 2155-2165.   DOI: 10.11772/j.issn.1001-9081.2022060908
Abstract252)   HTML13)    PDF (3409KB)(145)       Save

To solve the problem of low detection precision of weakly perceived objects with missing shapes in distant or occluded scenes, a Weakly Perceived object detection method based on point cloud Completion and Multi-resolution Transformer (WP-CMT) was proposed. Firstly, since that some key information was lost due to the down-sampling convolution operation in object detection network, the Part-Aware and Aggregation (Part-A2) method with deconvolution up-sampling structure was chosen as the basic network to generate the initial proposals. Then, in order to enhance the shape and position features of the weakly perceived objects in the initial proposals, the point cloud completion module was applied to reconstruct the dense point sets on the surface of the weakly perceptive objects, and a novel multi-resolution Transformer feature encoding module was constructed to aggregate the completed shape features with original spatial location information of the weakly perceived objects, and then the enhanced local features of the weakly perceived objects were captured by encoding the contextual semantic correlation of the aggregated features on local coordinate point sets with different resolutions. Finally, the refined bounding boxes were generated. Experimental results show that WP-CMT achieves 2.51 percentage points gain on average precision and 1.59 percentage points on mean average precision compared to baseline method Part-A2 for the weakly perceived objects at hard level in KITTI and Waymo datasets, which proves the effectiveness of the proposed method for weakly perceived object detection. Meanwhile, ablation experimental results show that the point cloud completion and multi-resolution Transformer feature encoding modules in WP-CMT can effectively improve the detection performance of weakly perceived objects for different Region Proposal Network (RPN) structures.

Table and Figures | Reference | Related Articles | Metrics